本机环境

操作系统：win10

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
> scala -version
Scala code runner version 2.12.7 -- Copyright 2002-2018, LAMP/EPFL and Lightbend, Inc.


> java -version
java version "1.8.0_271"
Java(TM) SE Runtime Environment (build 1.8.0_271-b09)
Java HotSpot(TM) 64-Bit Server VM (build 25.271-b09, mixed mode)


> mvn -version
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Maven home: E:\apache-maven-3.6.3\bin\..
Java version: 1.8.0_261, vendor: Oracle Corporation, runtime: C:\Program Files\Java\jdk1.8.0_261\jre
Default locale: zh_CN, platform encoding: GBK
OS name: "windows 10", version: "10.0", arch: "amd64", family: "windows"


> git --version
git version 2.27.0.windows.1

flink 源码编译

maven mirror 配置

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
<mirror>
  <id>nexus-aliyun</id>
  <mirrorOf>*,!jeecg,!jeecg-snapshots,!mapr-releases</mirrorOf>
  <name>Nexus aliyun</name>
  <url>http://maven.aliyun.com/nexus/content/groups/public</url>
</mirror>
<mirror>
  <id>mapr-public</id>
  <mirrorOf>mapr-releases</mirrorOf>
  <name>mapr-releases</name>
  <url>https://maven.aliyun.com/repository/mapr-public</url>
  </mirror>
<mirror>
  <id>confluent</id>
  <mirrorOf>confluent</mirrorOf>
  <name>confluent</name>
  <url>http://packages.confluent.io/maven/</url>
</mirror>

源码下载编译

  • 下载

    1
    git clone git@github.com:apache/flink.git

  • 下载完后直接导入idea

  • 切换分支到release-1.16

  • 执行如下操作
    1615126622(1).jpg

注:编译整体项目前建议先手动编译flink-runtime-web模块

pom 文件修改

1
2
3
4
5
6
<configuration>
    <arguments>ci --cache-max=0 --no-save ${npm.proxy}</arguments>
    <environmentVariables>
        <HUSKY_SKIP_INSTALL>true</HUSKY_SKIP_INSTALL>
    </environmentVariables>
</configuration>

替换为

1
2
3
4
5
6
7
8
<configuration>
    <arguments>install -g -registry=https://registry.npm.taobao.org
        --cache-max=0 --no-save
    </arguments>
    <environmentVariables>
        <HUSKY_SKIP_INSTALL>true</HUSKY_SKIP_INSTALL>
    </environmentVariables>
</configuration>
1
2
3
4
5
6
7
8
cd flink-runtime-web

cd web-dashboard

# 此处使用项目里的npm
./node/npm install

./node/npm run build
  • 开始编译
    1
    2
    3
    4
    5
    mvn clean install -DskipTests -Dfast

    或

    mvn clean install -DskipTests -Drat.skip=true -Dcheckstyle.skip=true -Dscala=2.12.7

编译报错

编译期间若有jar下载不到, 到这下载

注意替换包路径

下载完后添加到本地maven仓库对应的路径下面

编译失败后从失败处继续往下编译,如下为flink-avro-confluent-registry编译失败

mvn -rf :flink-avro-confluent-registry clean install -DskipTests -Drat.skip=true -Dcheckstyle.skip=true -Dscala=2.12.12

跳过失败的模块，最后再报错

mvn clean install –fail-at-end

IDEA运行flink 报Error:java: 无效的标记: –add-exports=java.base/sun.ne

“Intellij” -> “View” -> “Tool Windows” ->”Maven” -> “Profiles” -> 取消 “java11” -> 重新导入 maven 项目。
重新reload maven

java: 警告: 源发行版 11 需要目标发行版 11

修改parent-pom(根目录pom文件)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
<!-- 大概在1001行 -->
<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-compiler-plugin</artifactId>
    <configuration>
        <!-- 此处 11 改为 8 -->
        <source>11</source>
        <target>11</target>
        <compilerArgs combine.children="append">
            <arg>--add-exports=java.base/sun.net.util=ALL-UNNAMED</arg>
            <arg>--add-exports=java.management/sun.management=ALL-UNNAMED</arg>
            <arg>--add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED</arg>
            <arg>--add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED</arg>
        </compilerArgs>
    </configuration>
</plugin>